FILE NO. PHLY-24,738 



METHOD AND APPARATUS FOR MATCHING A USER'S USE PROFILE IN 
COMMERCE WITH A BROADCAST 



Inventors: 



Jeffiy Jovan Philyaw 
David Kent Mathews 



Express Mail No. EL0213201 15US 



FILE NO. PHLY-24,738 



2 



PATENT 



IN THE UNITED STATES PATENT AND TRADEMARK OFFICE 



METHOD AND APPARATUS FOR MATCHING A USER'S USE PROFILE 
IN COMMERCE WITH A BROADCAST 



TECHNICAL FIELD OF THE INVENTION 

The present invention is related to a method of computer control and, more 
particularly, to a system for matching a user's use profile in commerce with a 
broadcast. 

CROSS-REFERENCE TO RELATED APPLICATIONS 

I' J) This application's a Continuation-in-Part of pending U.S. Patent Application 

^rial No. (At|y Dkt. No. PHLY-24,669) entitled "METHOD AND 

APPARATUS FOR ACCESSh(G A REMOTE LOCATION BY SCANNING AN 
5 OPTICAL CODE," filed on Augik 19, 1999, which is a Continuation-in-Part of the 
following two pending U.S. Patent Applications: Serial No. 09/151,471 (Atty Dkt. 
No. PHLY-24,397) entitled "METHODvFOR INTERFACING SCANNED 
PRODUCT INFORMATION WITH A SOimCE FOR THE PRODUCT OVER A 
GLOBAL NETWORK," and Serial No. 09/15^530 (Atty Dkt. No. PHLY-24,398) 
1 0 entitled "METHOD FOR CONTROLLING A COMPUTER WITH AN AUDIO 



SIGNAL," both filed on September 11, 1998; the present application being related to 

the following pending U.S. Patent Applications: Serial No. (Atty Dkt. 

No. PHLVr24,668) entitled "INTERACTIVE DOLL," filed on August 19, 1999; 

Serial No. _\ (Atty Dkt. No. PHLY-24,670) entitled "METHOD AND 

APPARATUS FOR EMBEDDING ROUTING INFORMATION TO A REMOTE 
WEB SITE IN AN AUDIOmDEO TRACK," filed on August 19, 1999; Serial No. 

(Atty Wt. No. PHLY-24,703) entitled "METHOD AND APPARATUS 

FOR CONTROLUNG A COMPUTER FROM A REMOTE LOCATION," filed on 

August 19, 1999; Se\ial No. (Atty Dkt No. PHLY-24,705) entitled "A 

METHOD FOR COnVrOLLING A COMPUTER USING AN EMBEDDED 
UNIQUE CODE IN THE CONTENT OF VIDEO TAPE MEDIA," filed on August 
19, 1999; Serial No. \ (Atty Dkt. No. PHLY-24,706) entitled "A 
METHOD FOR CONTROLLING A COMPUTER USING AN EMBEDDED 
UNIQUE CODE IN THE CONTENT OF DVD MEDIA," filed on August 19, 1999; 

Serial No. (Atty Dk^No. PHLY-24,707) entitled "A METHOD FOR 

CONTROLLING A COMPUTERyUSING AN EMBEDDED UNIQUE CODE IN 

THE CONTENT OF CD MEDIA,' Viled on August 19, 1999; Serial No. 

(Atty Dkt. No. PHLY-24,708) entitleV'A METHOD FOR CONTROLLING A 
COMPUTER USING AN EMBEDDED UNIQUE CODE IN THE CONTENT OF 
DAT MEDIA," filed on August 19, 1999: and related to the following co-pending 
U.S. Patent Applications filed on even date with the present application: Serial No. 

(Atty Dkt. No. PHLY-24,73l\ entitled "METHOD AND 
APPARATUS FOR OPENING AND LAUNCHING A WEB BROWSER IN 

RESPONSE TO AN AUDIBLE SIGNAL;" S^al No. (Atty Dkt. No. 

PHLY-24,732) entitled "METHOD AND APPARATUS FOR COMPLETING, 
SECURING AND CONDUCTING AN E-COMMERCE TRANSACTION;" Serial 

No. (Atty Dkt. No. PHLY-24,733\entitled "METHOD AND 

APPARATUS FOR TRACKING USER PROFILE AND HABITS ON A GLOBAL 
NETWORK;" Serial No. (Atty Dkt. No\ PHLY-24,734) entitled 
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'METHODWflD APPARATUS FOR DIRECTING AN EXISTING PRODUCT 

CODE TO A REMOTE LOCATION;" Serial No. (Atty Dkt. No. 

PHLY-24,735) Entitled "METHOD AND APPARATUS FOR LAUNCHING A 
WEB SITE WITHvA NON-STANDARD CONTROL INPUT DEVICE;" Serial No. 

5 (Attyvpkt. No. PHLY-24,736) entitled "METHOD AND 

APPARATUS FOR ALLOWING A BROADCAST TO REMOTELY CONTROL A 

COMPUTER;" Serial No. (Atty Dkt. No. PHLY-24,737) entitled 

"METHOD AND APPARATUS FOR LAUNCHING A WEB SITE IN RESPONSE 

TO SCANNING OF A PRODUCT CODE;" Serial No. (Atty Dkt. 

1 0 No. PHLY-24,739) entitled ''WeTHOD AND APPARATUS FOR UTILIZING AN 
AUDIBLE SIGNAL TO INDUCE A USER TO SELECT AN E-COMMERCE 
FUNCTION;" Serial No. \ (Atty Dkt. No. PHLY-24,740) entitled "A 

COMBINED PRODUCT CODE INSIGNIA FOR SIGNIFYING AN 

INTERNAL INTERACTIVE CODeV Serial No. (Atty Dkt. No. 

1 5 PHLY-24,741 ) entitled "DIGITAL ID mR SELECTING WEB BROWSER AND 
USE PREFERENCES OF A USER DURWG USE OF A WEB APPLICATION;" 

Serial No. (Atty Dkt. No. PHBY-24,742) entitled "UNIQUE ID FOR 

IDENTIFYING A USER AND FACILITATING AN E-COMMERCE 

TRANSACTION;" Serial No. (Atty Dkt. No. PHLY-24,743) entitled 

20 "METHOD AND APPARATUS FOR LINKING A WEB BROWSER TO A 

PROMOTIONAL OFFER OVER A GLOBAL nWwORK;" Serial No. 

(Atty Dkt. No. PHLY-24,744) entitled "METHOD AND 

APPARATUS FOR CONTROLLING A USER'S POTHROUGH AN 
AUDIOA^ISUAL BROADCAST TO ARCHIVE INFORMATION IN THE USER'S 

25 PC;" Serial No. (Atty Dkt. No. PHLY-24,7^5) entitled "METHOD 

AND APPARATUS FOR UTILIZING AN EXISTING PRODUCT CODE TO 
ISSUE A MATCH TO A PREDETERMINED LOCATIONDN A GLOBAL 

NETWORK;" Serial. No. (Atty Dkt. No. PHL^Y^4j747) entitled 

"NETWORK ROUTING UTILIZING A PRODUCT CODE;" a^d Serial No. 



(Atty^kt. No. PHLY-24,748) entitled "METHOD FOR 

INTERCONNECTmG TWO LOCATIONS OVER A NETWORK IN RESPONSE 
TO USING A TOOL." \ 
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BACKGROUND OF THE INVENTION 

With the growing numbers of computer users connecting to the "Internet," 
many companies are seeking the substantial commercial opportunities presented by 
such a large user base. For example, one technology which exists allows a television 
5 ("TV") signal to trigger a computer response in which the consumer will be guided to 
a personalized web page. The source of the triggering signal may be a TV, video 
tape recorder, or radio. For example, if a viewer is watching a TV program in which 
an advertiser offers viewer voting, the advertiser may transmit a unique signal within 
the television signal which controls a program known as a "browser" on the viewer's 
fl 10 computer to automatically display the advertiser's web page. The viewer then simply 
S makes a selection which is then transmitted back to the advertiser. 

: \^ 
■ ; ^ 

'H In order to provide the viewer with the capability of responding to a wide 

variety of companies using this technology, a database of company information and 
Uniform Resource Locator ("URL") codes is necessarily maintained in the viewer's 
ry 15 computer, requiring continuous updates. URLs are short strings of data that identify 
ifl resources on the Internet: documents, images, downloadable files, services, electronic 

""■^ mailboxes, and other resources. URLs make resources available under a variety of 

naming schemes and access methods such as HTTP, FTP, and Internet mail, 
addressable in the same simple way. URLs reduce the tedium of "login to this 
20 server, then issue this magic command ..." down to a single click. The Internet uses 
URLs to specify the location of files on other servers. A URL includes the type of 
resource being accessed (e.g., Web, gopher, FTP), the address of the server, and the 
location of the file. The URL can point to any file on any networked computer. 
Current technology requires the viewer to perform periodic updates to obtain the 
25 most current URL database. This aspect of the current technology is cumbersome 

since the update process requires downloading information to the viewer's computer. 
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Moreover, the likelihood for error in performing the update, and the necessity of 
redoing the update in the event of a later computer crash, further complicates the 
process. Additionally, current technologies are limited in the number of companies 
which may be stored in the database. This is a significant limitation since world- 
5 wide access presented by the Internet and the increasing number of companies 
connecting to perform on-line E-commerce necessitates a large database. 
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SUMMARY OF THE INVENTION 

The present invention disclosed and claimed herein comprises a method for 
advertising over a network and broadcast media combination. A user's computer at a 
location on the network is operable to receive a signal from a broadcast generated by 
5 an advertiser, which signal has embedded therein unique coded information. The 

user's computer is connected to an advertiser's location in response to extracting the 
unique coded information from the audio signal. The advertiser's location is 
correlated to the unique coded information. The operation of connecting causes 
profile information of the user to be sent to the advertiser's location over the 
10 network. The profile at the advertiser's location is then received, and information 
generated to forward to the user based upon the user's profile forwarded thereto. 
This information is then forward to the cormected user. 
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BRIEF DESCRIPTION OF THE DRAWINGS 

For a more complete understanding of the present invention and the 
advantages thereof, reference is now made to the following description taken in 
conjunction with the accompanying Drawings in which: 
5 FIGURE 1 illustrates a block diagram of the preferred embodiment; 

FIGURE 2 illustrates the computer components employed in this 
embodiment; 

FIGURE 3 illustrates system interactions over a global network; 
FIGURES 4a-4e illustrate the various message packets transmitted between 
CX 10 the source PC and network servers used in the preferred embodiment; -and 

FIGURE 5 is a flowchart depicting operation of the system according to the 
preferred embodiment/^ 

FIGURE 6 illustrates a flowchart of actions taken by the Advertiser 
Reference Server ("ARS") server; 
15 FIGURE 7 illustrates a flowchart of the interactive process between the 

source computer and ARS; 
y FIGURE 8 illustrates a web browser page receiving the modified 

URL/advertiser product data according to the preferred embodiment; 

FIGURE 9 illustrates a simplified block diagram of the disclosed 
20 embodiment; 

FIGURE 10 illustrates a more detailed, simplified block diagram of the 
embodiment of FIGURE 9; 

FIGURE 1 1 illustrates a diagrammatic view of a method for performing the 
routing operation; 

25 FIGURE 12 illustrates a block diagram of an alternate embodiment utilizing 

an optical region in the video image for generating the routing information; 

FIGURE 13 illustrates a block diagram illustrating the generation of a profile 
with the disclosed embodiment; 
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FIGURE 14 illustrates a flowchart for generating the profile and storing at the 

ARS; 

FIGURE 15 illustrates a flowchart for processing the profile information 
when information is routed to a user; 
5 FIGURE 16 illustrates a general block diagram of a disclosed embodiment; 

FIGURE 16a illustrates a flowchart depicting the operation wherein the input 
device is registered; 

FIGURE 17 illustrates the conversion circuit of the wedge interface; 

FIGURE 1 8 illustrates a sample message packet transmitted from the user PC 
10 to the ARS; 

FIGURE 19 illustrates a more detailed block diagram of the routing of the 
message packets between the various nodes; 

FIGURE 20 illustrates a block diagram of a browser window, according to a 
disclosed embodiment; 

15 FIGURE 21 illustrates a diagrammatic view of information contained in the 

ARS database; 

FIGURE 22 illustrates a flowchart of the process of receiving information for 
the user's perspective; 

FIGURE 23 illustrates a flowchart according to the ARS; 
20 FIGURE 24 illustrates a flowchart of the process performed at the E- 

commerce node; 

FIGURE 25 illustrates a block diagram of the system for allowing 
promotional offers to be provided over the network; 

FIGURE 26 illustrates a flowchart depicting the operation at the advertiser for 
25 initiating a promotional offer; 

FIGURE 27 illustrates the operation at the user's PC for interconnecting with 
the promotion; 
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FIGURE 28 illustrates a flowchart depicting the operation at the advertiser of 
completing the promotion after interfacing with the user; and 

FIGURE 29 illustrates a flowchart of the interaction of an advertiser with a 
user, wherein the user profile is used for customizing purposes. 
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DETAILED DESCRIPTION OF THE INVENTION 

Referring now to FIGURE 1, there is illustrated a block diagram of a system 
for controlling a personal computer ("PC") 1 12 via an audio tone transmitted over a 
wireless system utilizing a TV. In the embodiment illustrated in FIGURE 1, there is 
5 • provided a transmission station 101 and a receive station 117 that are connected via a 
communication link 108. The transmission station 101 is comprised of a television 
program source 104, which is operable to generate a program in the form of a 
broadcast signal comprised of video and audio. This is transmitted via conventional 
techniques along channels in the appropriate frequencies. The program source is 

10 input to a mixing device 106, which mixing device is operable to mix in an audio 
signal. This audio signal is derived from an audio source 100 which comprises a 
coded audio signal which is then modulated onto a carrier which is combined with 
the television program source 104. This signal combining can be done at the audio 
level, or it can even be done at the RF level in the^,ftem-of a different earner. 

15 However, the preferred method is to merely sum the audio signal from the modulator 
102 into the audio channel of the program that is generated by the television program 
source 104. The output thereof is provided from the mixing device 106 in the form 
of broadcast signal to an antenna 102^hich transmits the information over the 
communication link 108 to an antenna 109 on the receive side. 

20 On the receive side of the system, a conventional receiver 110, such as a 

television is provided. This television provides a speaker output which provides the 
user with an audible signal. This is typically associated with the program. However, 
the receiver 1 10 in the disclosed embodiment, also provides an audio output jack, this 
being the type RCA jack. This jack is utilized to provide an audio output signal on a 

25 line 113 which is represented by an audio signal 111. This line 113 provides all of 

the audio that is received over the communication link 108 to the PC 1 12 in the audio 
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input port on the PC 1 12. However, it should be understood that, although a direct 
connection is illustrated from the receiver 1 10 to the PC 112, there actually could be 
a microphone pickup at the PC 1 12 which could pick the audio signal up. In the 
disclosed embodiment, the audio signal generated by the advertiser data input device 
5 100 is audible to the human ear and, therefore, can be heard by the user. Therefore, 

no special filters are needed to provide this audio to the PC 112. 

The PC 1 12 is operable to run programs thereon which typically are stored in 
a program file area 116. These programs can be any type of programs such as word 
processing programs, application programs, etc. In the disclosed embodiment, the 

10 program that is utilized in the system is what is referred to as a "browser." The PC 
112 runs a browser program to facilitate the access of information on the network, for 
example, a global communication network known as the "Internet" or the World- 
Wide- Web ("Web"). The browser is a hypertext-linked application used for 
accessing information. Hypertext is a term used to describe a particular organization 

15 of information within a data processing system, and its presentation to a user. It 
exploits the computer's ability to link together information from a wide variety of 
sources to provide the user with the ability to explore a particular topic. The 
traditional style of presentation used in books employs an organization of the 
information which is imposed upon it by limitations of the medium, namely fixed 

20 sized, sequential paper pages. Hypertext systems, however, use a large number of 
units of text or other types of data such as image information, graphical information, 
video information, or sound information, which can vary in size. A collection of 
such units of information is termed a hypertext document, or where the hypertext 
documents employ information other than text, hypermedia documents. Multimedia 

25 communications may use the Hypertext Transfer Protocol ("HTTP"), and files or 

formatted data may use the Hypertext Markup Language ("HTML"). This formatting 
language provides for a mingling of text, graphics, sound, video, and hypertext links 
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by "tagging" a text document using HTML. Data encoded using HTML is often 
referred to as an "HTML document/' an "HTML page," or a "home page." These 
documents and other Internet resources may be accessed across the network by 
means of a network addressing scheme which uses a locator referred to as a Uniform 
5 Resource Locator ("URL"), for example, "http://www.digital.com." 

The Internet is one of the most utilized networks for interconnecting 
distributed computer systems and allows users of these computer systems to 
exchange data all over the world. Connected to the Intemet are many private 
networks, for example, corporate or commercial networks. Standard protocols, such 

10 as the Transport Control Protocol ("TCP") and the Intemet Protocol ("IP") provide a 
convenient method for communicating across these diverse networks. These 
protocols dictate how data are formatted and communicated. As a characteristic of 
the Intemet, the protocols are layered in an IP stack. At higher levels of the IP stack, 
such as the application layer (where HTTP is employed), the user information is 

15 more readily visible, while at lower levels, such as the network level (where TCP/IP 
are used), the data can merely be observed as packets or a stream of rapidly moving 
digital signals. Superimposed on the Intemet is a standard protocol interface for 
accessing Web resources, such^gervers, files, Web pages, mail messages, and the like. 
One way that Web resources can be accessed is by browsers made by Netscape® and 

20 Microsoft Internet Explorer®, 

Referring again now to FIGURE 1 , the user can load this program with the 
appropriate keystrokes such that a browser window will be displayed on a display 
118. In one embodiment, the user can mn the browser program on the PC 1 12 such 
that the browser window is displayed on the display 118. While watching a preferred 
25 program, the user can also view display 1 1 8. When an audio signal is received by the 
receiver 1 10 and the encoded information is contained therein that was input thereto 
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by the advertiser, the PC 1 12 will then perform a number of operations. The first 
operation, according to the disclosed embodiment, is to extract the audio information 
within the received audio signal in the form of digital data, and then transmit this 
digital data to a defined location on the global communication network via a modem 
5 connection 1 14. This connection will be described hereinbelow. This information 
will be relayed to a proprietary location and the instructions sent back to the PC 1 12 
as to the location of the advertiser associated with the code, and the PC 1 12 will then 
effect a communication link to that location such that the user can view on the 
display 118 information that the advertiser, by the fact of putting the tone onto the 

10 broadcast channel, desires the viewer to view. This information can be in the form of 
interactive programs, data files, etc. In one example, when an advertisement appears 
on the television, the tone can be generated and then additional data displayed on the 
display 118. Additionally, a streaming video program could be played on the PC 
received over the network, which streaming video program is actually longer than the 

15 advertising segment on the broadcast. Another example would be a sports game that 
would broadcast the tone in order to allow a user access to information that is not 
available over the broadcast network, such as additional statistics associated with the 
sports program, etc. 

By utilizing the system described herein with respect to the disclosed 
20 embodiment of FIGURE 1, an advertiser is allowed the abiHty to control a user's PC 
1 12 through the use of tones embedded within a program audio signal. As will 
d ep oried ^hereinbelow, the disclosed embodiment utilizes particular routing 
information stored in the PC 1 12 which allows the encoded information in the 
received audio signal to route this information to a desired location on the network^ 
25 and then allow other routing information to be returned to the PC 1 12 for control 
thereof to route the PC 1 12 to the appropriate location associated with that code. 
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Referring now to FIGURE 2, there is illustrated a computer 204, similar to 
computer 1 12, connected to display information on display 118. The computer 204 
comprises an internal audio or "sound" card 206 for receiving the transmitted audio 
signal through receive antenna 109 and receiver 1 10. The sound card 206 typically 
5 contains analog-to-digital circuitry for converting the analog audio signal into a 

digital signal. The digital signal may then be more easily manipulated by software 
programs. The receiver 110 separates the audio signal from the video signal. A 
special trigger signal located within the transmitted advertiser audio signal triggers 
proprietary software running on the computer 204 which launches a communication 

10 application, in this particular embodiment, the web browser application located on 
the PC 204. Coded advertiser information contained within the audio signal is then 
extracted and appended with the address of a proprietary server located on the 
communication network. The remote server address is in the form of a URL. This 
appended data, in addition to other control codes, is inserted directly into the web 

15 browser application for automatic routing to the communication network. 

The web browser running on PC 204, and communicating to the network -with 
^through an internal modem 208, in this embodiment, transmits the advertiser 
information to the remote server. The remote server cross-references the advertiser 
product information to the address of the advertiser server located on the network. 

20 The address of the advertiser server is routed back through the PC 204 web browser 
to the advertiser server. The advertiser product information is returned to PC 204 to 
be presented to the viewer on display 118. In this particular embodiment, the 
particular advertiser product information displayed is contained within the 
advertiser's web page 212. As mentioned above, the audio signal is audible to the 

25 human ear. Therefore the audio signal, as emitted from the TV speakers, may be 
input to the sound card 206 via a microphone. Furthermore, the audio signal need 
not be a real-time broadcast, but may be on video tapes, CDs, DVD, or other media 
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which may be displayed at a later date. With the imminent implementation of high 
definition digital television, the audio signal output from the TV may also be digital. 
Therefore, direct input into a sound card for A/D purposes may not be necessary, but 
altemative interfacing techniques to accommodate digital-to-digital signal formats 
5 would apply. 

Referring now to FIGURE 3, there is illustrated a source PC 302, similar to 
PCs 204 and 112, connected to a global communication network|^06 through an 
interface 304. In this embodiment, the audio signal 1 1 1 is received by PC 302 
through its sound card 206. The audio signal 111 comprises a trigger signal which 

10 triggers proprietary software into launching a web browser application residing on 
the PC 302. The audio signal 1 1 1 also comprises advertiser product information 
which is extracted and appended with URL information of an Advertiser Reference 
Server ("ARS") 308. The ARS 308 is a system disposed on the^Jetaitotk that is 
defined as the location to which data in the audio signal 111 is to be routed. As such, 

1 5 data in the audio signal 1 1 1 will always be routed to the ARS 308, since a URL is 

unique on the^ network cystem . Connected to the ARS 308 is a database 310 of 
product codes and associated manufacturer URLs. The database 3 10 undergoes a 



continual update process which is transparent to the user. As companies sign-on, 
,^ubscribe, to this technology, manufacturer and product information is added to 



20 the database 310 without interrupting operation of the source PC 302 with frequent 

updates. When the advertiser server address URL is obtained fi-om the ARS database 
310, it and the request for the particular advertiser product information^ 
automatically routed back through the web browser on PC 302, over to the respective 
advertiser server for retrieval of the advertiser product information to the PC 302. 4t- 

25 ^hould - bc notdd that i^lthough the disclosed invention discusses a global 

communication network, the system is also applicable to LANs, WANs, and peer-to- 
peer network configurations. It should be noted that the disclosed architecture is not 
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limited to a single source PC 302, but may comprise a plurality of source PCs, e.g., 
PC 300 and PC 303. Moreover, a plurality of ARS 308 systems and advertiser 
servers 312 may be implemented, e.g., ARS 314, and advertiser server A 316, 
respectively. 

5 The information transactions, in general, which occur between the networked 

systems of this embodiment, over the communication network, are the following. 
The web browser running on source PC 302 transmits a message packet to the ARS 
308 over Path "A." The ARS 308 decodes the message packet and performs a cross- 
reference function with product information extracted from the received message 

10 packet to obtain the address of an advertiser serve r? 12. A new message packet is 

assembled comprising the advertiser server 312 address, and sent back to the source 
PC 302 over Path "B." A "handoff ' operation is performed whereby the source PC 
302 browser simply reroutes the information on to the advertiser server 312 over Path 
"C," with the appropriate source and destination address appended. The advertiser 

15 server 312 receives and decodes the message packet. The request- for-advertiser- 
product-information is extracted and the advertiser 312 retrieves the requested 
information from its database for transmission back to the source PC 302 over Path 
"D." The source PC 302 then processes the information, i.e., for display to the 
viewer. The optional Path "E" is discussed hereinbelow. It should be noted that the 

20 disclosed methods are not limited to only browser communication applications, but 
may accommodate, with sufficient modifications by one skilled in the art, other 
communication applications used to transmit information over the Internet or 
communication network. 

Referring now to FIGURE 4a, the message packet 400 sent from the source 
25 PC 302 to ARS 308 via Path "A" comprises several fields. One field comprises the 
URL of the ARS 308 which indicates where the message packet is to be sent. 
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Another field comprises the advertiser product code or other information derived 
from the audio signal 111, and any additional overhead information required for a 
given transaction. The product code provides a link to the address of the advertiser 
server 312, located in the database 310. Yet another field comprises the network 
5 address of the source PC 302. In general, network transmissions are effected in 

packets of information, each packet providing a destination address, a source address, 
and data. These packets vary depending upon the network transmission protocol 
utilized for communication. Although the protocols utilized in the disclosed 
embodiment are of a conventional protocol suite commonly known as TCP/IP, it 

10 should be understood that any protocols providing the similar basic functions can be 
used, with the primary requirement that a browser can forward the routing 
information to the desired URL in response to keystrokes being input to a PC. 
However, it should be understood that any protocol can be used, with the primary 
requirement that a browser can forward the product information to the desired URL 

15 in response to keystrokes being input to a PC. Within the context of this disclosure, 

"message packet" shall refer to and comprise the destination URL, product 
information, and source address, even though more than a single packet must be 
transmitted to effect such a transmission. 

Upon receipt of the message packet 400 from source PC 302, ARS 308 
20 processes the information in accordance with instructions embedded in the overhead 
information. The ARS 308 specifically will extract the product code information 
from the received packet 400 and, once extracted, will then decode this product code 
information. Once decoded, this information is then compared with data contained 
within the ARS advertiser database 310 to determine if there is a "hit." If there is no 
25 "hit" indicating a match, then information is returned to the browser indicating such. 
If there is a "hit," a packet 402 is assembled which comprises the address of the 
source PC 302, and information instructing the source PC 302 as to how to access, 
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directly in a "handoff ' operation, another location on the network, that of an 
advertiser server 312. This type of construction is relatively conventional with 
browsers such as Netscape® and Microsoft Internet Explorer® and, rather than 
displaying information from the ARS 308, the source PC 302 can then access the 
5 advertiser server 312. The ARS 308 transmits the packet 402 back to source PC 302 
over Path "B." Referring now to FIGURE 4b, the message packet 402 comprises the 
address of the source PC 302, the URL of the advertiser server 312 embedded within 
instructional code, and the URL of the ARS 308. 

Upon receipt of the message packet 402 by the source PC 302, the message 
10 packet 402 is disassembled to obtain pertinent routing information for assembly of a 
new message packet 404. The web browser running on source PC 302 is now 
directed to obtain, over Path "C," the product information relevant to the particular 
advertiser server 312 location information embedded in message packet 404. 
Referring now to FIGURE 4c, the message packet 404 for this transaction comprises 
15 the URL of the advertiser server 312, the request-for-product-information data, and 

the address of the source PC 302. 

Upon receipt of the message packet 404 from source PC 302, advertiser 
server 312 disassembles the message packet 404 to obtain the request- for-product- 
information data. The advertiser server 312 then retrieves the particular product 
20 information from its database, and transmits it over Path "D" back to the source PC 
302. Referring now to FIGURE 4d, the message packet 406 for this particular 
transaction comprises the address of the source PC 302, the requested information, 
and the URL of the advertiser server 312. 

Optionally, the ARS 308 may make a direct request for product information 
25 over Path "E" to advertiser server 312. In this mode, the ARS 308 sends information 
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to the advertiser server 312 instructing it to contact the source PC 302. This, 
however, is unconventional and requires more complex software control. The 
message packet 408 for this transaction is illustrated in FIGURE 4e, which comprises 
the URL of the advertiser server 312, the request-for-product-information data, and 
5 the address of the source PC 302. Since product information is not being returned to 
the ARS 308, but directly to the source PC 302, the message packet 408 requires the 
return address to be that of the source PC 302. The product information is then 
passed directly to PC 302 over Path "D." 

Referring now to FIGURE 5, the method for detecting and obtaining product 

10 information is as follows. In decision block 500, a proprietary application running 
resident on a source computer PC 302 (similar to PC 204) monitors the audio input 
for a special trigger signal. Upon detection of the trigger signal, data following the 
trigger signal is decoded for further processing, in function block 502. In function 
block 504, the data is buffered for further manipulation. In decision block 506, a 

1 5 determination is made as to whether the data can be properly authenticated. If not, 
program flow continues through the "N" signal to fiinction block 520 where the data 
is discarded. In function block 522, the program then signals for a retransmission of 
the data. The system then waits for the next trigger signal, in decision block 500. If 
properly authenticated in decision block 506, program flow continues through the 

20 "Y" signal path where the data is then used to launch the web browser application, as 
indicated in function block 508. In function block 510, the web browser receives the 
URL data, which is then automatically routed through the computer modem 208 to 
the network interface 304 and ultimately to the network 306. In function block 514, 
the ARS 308 responds by returning the URL of advertiser server 312 to the PC 302. 

25 In function block 516, the web browser running on the source PC 302, receives the 

advertiser URL information from the ARS 308, and transmits the URL for the 
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product file to the advertiser server»312. In block 518, the advertiser server 312 
responds by sending the product information to the source PC 302 for processing. 

The user may obtain the benefits of this architecture by simply downloading 
the proprietary software over the network. Other methods for obtaining the software 
5 are well-known; for example, by CD, diskette, or pre-loaded hard drives. 

Referring now to FIGURE 6, there is illustrated a flowchart of the process the 
ARS 308 may undergo when receiving the message packet 400 fi-om the source PC 
302. In decision block 600, the ARS 308 checks for the receipt of the message 
packet 400. If a message packet 400 is not received, program flow moves along the 

10 "N" path to continue waiting for the message. If the message packet 400 is received, 
program flow continues along path "Y" for message processing. Upon receipt of the 
message packet 400, in fiinction block 602, the ARS 308 decodes the message packet 
400. The product code is then extracted independently in function block 604 in 
preparation for matching the product code with the appropriate advertiser server 

15 address located in the database 310. In function block 606, the product code is then 

used with a lookup table to retrieve the advertiser server 312 URL of the respective 
product information contained in the audio signal data. In function block 608, the 
ARS 308 then assembles message packet 402 for transmission back to the source PC 
302. Function block 610 indicates the process of sending the message packet 402 

20 back to the source PC 302 over Path "B." 

Referring now to FIGURE 7, there is illustrated a flowchart of the interactive 
processes between the source PC 302 and the advertiser server 312. In function 
block 700, the source PC 302 receives the message packet 402 back fi-om the ARS 
308 and begins to decode the packet 402. In function block 702, the URL of the 
25 advertiser product information is extracted fi"om the message packet 402 and saved 
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for insertion into the message packet 404 to the advertiser server 312. The message 
packet 404 is then assembled and sent by the source PC 302 over Path "C" to the 

3/2, fr^ 

advertiser server 3i2r^ function block 704. While the source PC 302 waits, in 
function block 706, the advertiser server 312 receives the message packet 404 from 
5 the source PC 302, in function block 708, and disassembles it. The product 

information location is then extracted from the message packet 404 in function block 
710. The particular product information is retrieved from the advertiser server 312 
database for transmission back to the source PC 302. In function block 712, the 
product information is assembled into message packet 406 and then transmitted back 
10 to the source PC 302 over Path "D." Returning to the source PC 302 in function 
block 714, the advertiser product information contained in the message packet 406 
received from the advertiser server 312, is then extracted and processed in function 
block 716. 

Referring now to FIGURE 8, after receipt of a trigger signal, a web browser 
15 application on a source PC 302 is automatically launched and computer display 800 

presents a browser page 802. Proprietary software running on the source PC 302 
processes the audio signal data after being digitized through the sound card 206. The 
software appropriately prepares the data for insertion directly into the web browser 
by extracting the product information code and appending keystroke data to this 
20 information. First, a URL page 804 is opened in response to a Ctrl-0 command 
added by the proprietary software as the first character string. Opening URL page 
804 automatically positions the cursor in a field 806 where additional keystroke data 
following the Ctrl-0 command will be inserted. After URL page 804 is opened, the 
hypertext protocol preamble http:// is inserted into the field 806. Next, URL 
25 information associated with the location of the ARS 308 is inserted into field 806. 
Following the ARS 308 URL data are the characters /? to allow entry of variables 
immediately following the /? characters. In this embodiment, the variable following 
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is the product information code received in the audio signal. The product code 
information also provides the cross-reference information for obtaining the advertiser 
URL from the ARS database 310. Next, a carriage return is added to send the 
URL/product data and close the window 804. After the message packet 400 is 
5 transmitted to the ARS 308 from the source PC 302, transactions from the ARS308, 
to the source PC 302, to the advertiser server 312, and back to the source PC 302, 
occur quickly and are transparent to the viewer. At this point, the next information 
the viewer sees is the product information which was received from the advertiser 
server 312. 

10 Referring now to FIGURE 9, there is illustrated a block diagram of a more 

simplified embodiment. In this embodiment, a video source 902 is provided which is 
operable to provide an audio output on an audio cable 901 which provides routing 
information referred to by reference numeral 904. The routing information 904 is 
basically information contained within the audio signal. This is an encoded or 

15 embedded signal. The important aspect of the routing information 904 is that it is 

automatically output in realtime as a function of the broadcast of the video program 
received over the video source 902. Therefore, whenever the program is being 
broadcast in realtime to the user 908, the routing information 904 will be output 
whenever the producer of the video desires it to be produced. It should be 

20 understood that the box 902 representing the video source could be any type of media 
that will result in the routing information being output. This could be a cassette 
player, a DVD player, an audio cassette, a CD ROM or any such media. It is only 
important that this is a program that the producer develops which the user 908 
watches in a continuous or a streaming manner. Embedded within that program, at a 

25 desired point selected by the producer, the routing information 904 is output. 



Attorney Docket No.: PHLY-24,738 



25 

The audio information is then routed to a PC 906, which is similar to the PC 
1 12 in FIGURE 1. A user 908 is interfaced with the PC to receive information 
thereof, the PC 906 having associated therewith a display (not shown). The PC 906 
is interfaced with a network 910, similar to the network 306 in FIGURE 3. This 
5 network 910 has multiple nodes thereon, one of which is the PC 906, and another of 
which is represented by a network node 912 which represents remote information. 
The object of the present embodiment is to access remote information for display to 
the user 908 by the act of transmitting from the video program in block 902 the 
routing information 904. This routing information 904 is utilized to allow the PC 
10 906 which has a network "browser" running thereon to "fetch" the remote 

information at the node 912 over the network 910 for display to the user 908. This 
routing information 904 is in the form of an embedded code within the audio signal, 
as was described hereinabove. 

Referring now to FIGURE 10, there is illustrated a more detailed block 
15 diagram of the embodiment of FIGURE 9. In this embodiment, the PC 906 is split 

up into a couple of nodes, a first PC 1002 and a second PC 1004. The PC 1002 
resides at the node associated with the user 908, and the PC 1004 resides at another 
node. The PC 1004 represents the ARS 308 of FIGURE 3. The PC 1004 has a 
database 1006 associated therewith, which is basically the advertiser database 310. 
20 Therefore, there are three nodes on the network 910 necessary to implement the 

disclosed embodiment, the PC 1002, the PC 1004 and the remote information node 
912. The routing information 904 is utilized by the PC 1002 for routing to the PC 
1004 to determine the location of the remote information node 912 on the network 
910. This is returned to the PC 1002 and a connection made directly with the remote 
25 information node 912 and the information retrieved therefrom to the user 908. The 
routing information 904 basically constitutes primary routing information. 

Attorney Docket No.: PHLY-24,738 



26 

Referring now to FIGURE 11, there is illustrated a diagrammatic view of how 
the network packet is formed for sending the primary routing information to the PC 
1004. In general, the primary routing information occupies a single field which 
primary routing information is then assembled into a data packet with the secondary 
5 routing information for transfer to the network 910. This is described hereinabove in 
detail. 

Referring now to FIGURE 12, there is illustrated an alternate embodiment to 
that of FIGURE 9. In this embodiment, the video source 902 has associated 
therewith an optical region 1202, which optical region 1202 has disposed therein an 

10 embedded video code. This embedded video code could be relatively complex or as 
simple as a grid of dark and white regions, each region in the grid able to have a dark 
color for a logic "1" or a white region for a logic "0." This will allow a digital value 
to be disposed within the optical region 1202. A sensor 1204 can then be provided 
for sensing this video code. In the example above, this would merely require an 

15 array of optical detectors, one for each region in the grid to determine whether this is 

a logic "1" or a logic "0" state. One of the sensed video is then output to the PC 906 
for processing thereof to determine the information contained therein, which 
information contained therein constitutes the primary routing information 904. 
Thereafter, it is processed as described hereinabove with reference to FIGURE 9. 

20 

Referring now to FIGURE 13, there is illustrated a block diagram for an 
embodiment wherein a user's profile can be forwarded to the original subscriber or 
manufacturer. The PC 906 has associated therewith a profile database 1302, which 
profile database 1302 is operable to store a profile of the user 908. This profile is 
25 created when the program, after initial installation, requests profile information to be 
input in order to activate the program. In addition to the profile, there is also a 
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unique ID that is provided to the user 908 in association with the browser program 
that runs on the PC 906. This is stored in a storage location represented by a block 
1304. This ID 1304 is accessible by a remote location as a "cookie" which is 
information that is stored in the PC 906 in an accessible location, which accessible 
5 location is actually accessible by the remote program running on a remote node. 

The ARS 308, which basically constitutes the PC 1004 of FIGURE 10, is 
operable to have associated therewith a profile database 1308, which profile database 
1308 is operable to store profiles for all of the users. The profile database 1308 is a 
combination of the stored in profile database 1302 for all of the PCs 906 that are 
att^hable ^^^^ ^-^^^t^' ^^^^^^ distinguished firom information stored in the 
datab ascStO^ the advertiser's database, which contains intermediate destination 
tables. When the routing information in the primary routing information 904 is 
forwarded to the ARS 308 and extracted fi"om the original data packet, the lookup 
procedure described hereinabove can then be performed to determine where this 
information is to be routed. The profile database 1302 is then utilized for each 
transaction, wherein each transaction in the form of the routing information recdved i , 
fi-om the primary routing information 904 is compared to the destination tables^310 
to determine what manufacturer it is associated^jvitfe. 

The associated ID 1304 that is transmitted along with the routing information 
20 in primary routing information 904 is then compared with the profile database 1308 
to determine if a profile associated therewith is available. This information is stored 
in a transaction database 1310 such that, at a later time, for each routing code 
received in the form of the informafion in primary routing information 904, there will 
associated therewith the IDs 1304 of each of the PCs 906. The associated profiles in 
25 database 1308, which are stored in association with IDs 1304, can then be assembled 
and transmitted to a subscriber as referenced by a subscriber node 1312 on the 
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network 910. The ARS 308 can do this in two modes, a realtime mode or a non- 
realtime mode. In a realtime mode, each time a PC 906 accesses the advertiser 
database 310, that user's profile information is uploaded to the subscriber node 1312. 
At the same time, billing information is generated for that subscriber 1312 which is 
5 stored in a billing database 1316. Therefore, the ARS 308 has the ability to inform 

the subscriber 1312 of each transaction, bill for those transactions, and also provide 
to the subscriber 1312 profile information regarding who is accessing the particular 
product advertisement having associated therewith the routing information field 904 
for a particular routing code as described hereinabove. This information, once 
10 assembled, can then be transmitted to the subscriber 1312 and also be reflected in 
billing information and stored in the billing information database 1316. 

Referring now to FIGURE 14, there is illustrated a flowchart depicting the 
operation for storing the profile for the user. The program is initiated in a block 1402 
and then proceeds to a function block 1404, wherein the system will prompt for the 

15 profile upon initiation of the system. This initiation is a function that is set to 

activate whenever the user initially loads the software that he or she is provided. The 
purpose for this is to create, in addition to the setup information, a user profile. Once 
the user is prompted for this, then the program will flow to a decision block 1406 to 
determine whether the user provides basic or detailed information. This is selectable 

20 by the user. If selecting basic, the program will flow to a function block 1408 

wherein the user will enter basic information such as name and serial number and 
possibly an address. However, to provide some incentive to the user to enter more 
information, the original prompt in function block 1404 would have offers for such 
things as coupons, discounts, -©te, if the user will enter additional information. If the 

25 user selects this option, the program^om the decision block 1406 to a fiincfion block 

1410. In the function block 1410, the user is prompted to enter specific information 
such as job, income level, general family history, demographic information and 
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more. There can be any amount of information collected in this particular function 
block. 



Once all of the information is collected, in either the basic mode or the more 
specific mode, the program will then flow to a function block 1412 where this 
5 information is stored locally. The program then flows to a decision block 1414 to 
then go on-line to the host or the ARS 308. In general, the user is prompted to 
determine whether he or she wants to send this information to the host at the present 
time or to send it later. If he or she selects the "later" option, the program will flow 
to a function block 1415 to prompt the user at a later time to send the information. In 
10 the disclosed embodiment, the user will not be able to utilize the software until the 
profile information is sent to the host. Therefore, the user may have to activate this 
at a later time in order to connect with the host. 



If the user has selected the option to upload the profile information to the 
host, the program will flow to the function block 1416 to initiate the connect process 

1 5 and then to a decision block 141 8 to determine if the connection has been made. If 
not, the program will flow along a "N" j)ath to a time to ' ^ gecision block 1420 which 
wiHiiffi^to an error block 1422 or back to the input of the connect decision block 
1418. The program, once connected, will then flow along a "Y" path from decision 
block 1418 to a fiinction block 1428 to send the profile information with the ID of 

20 the computer or user to the host. The ID is basically, as described hereinabove, a 

"cookie" in the computer which is accessed by the program when transmitting to the 
host. The program will then flow to a function block 1430 to activate the program 
such that it, at later time, can operate without requiring all of the ^sot up information. 
In general, all of the operation of this flowchart is performed with a "wizard" which 

25 steps the user through the setup process. Once complete, the program will flow to a 
Done block 1432. 
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Referring now to FIGURE 15, there is illustrated a flowchart depicting the . 

operation of the host when receiving a transaction. The program is initiated at a^tart 

block 1502 and then proceeds to decision block 1504, wherein it is determined 

whether the system has received a routing request, i.e., the routing information 904 in 

5 the form of a tone, etc., embedded in the audio signal^ as described hereinabove with 

respect to FIGURE 9. The program will loop back around to the input of decision 

block 1504 until the routing request has been received. At this time, the program will 

flow along the "Y" path to a function block 1506 to receive the primary routing 

information and the user ID. Essentially, this primary routing information is 

10 extracted from the audio tone, in addition to the user ID. The program then flows to 

a function block 1 508 to look up the manufacturer URL that corresponds to the 

received primary routing information and then return the necessary command 

108 

information to the originating PC 108 in order to allow that PCjo connect to the 
destination associated with the primary routing information. Thereafter, the program 

15 will flow to a function block 1510 to update the transaction database 1310 for the 

current transaction. In general, the routing information 904 will be stored as a single 
field with the associated IDs. The profile databas^ as described hereinabove, has 
associated therewith detailed profiles of each user on the system that has activated 
their software in association with their ID. Since the ID was sent in association with 

20 the routing information, what is stored in the transaction database^is the routing code, 

in association with all of the IDs transmitted to the system in association with that 

\3t0 

particular routing code. Once this transaction database^ias been updated, as 
described hereinabove, the transactions can be transferred back to the subscriber at 
node 312 with the detailed profile information from the profile database 1308. 



25 The profile information can be transmitted back to the subscriber or 

manufacturer^^wHhe node 312 in realtime or non-realtime. A decision block 1512 is 
provided for this, which determines if the delivery is realtime. If realtime, the 
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program will flow along a "Y" path to a function block 1514 wherein the information 
will be immediately forwarded to the manufacturer or subscriber. The program will 
then flow to a function block 1516 wherein the billing for that particular 
manufacturer or subscriber will be updated in the billing database 1316. The 
5 program will then flow into an End block 1518. If it was non-realtime, the program 
moves along the "N" path to a function block 1520 wherein it is set for a later 
delivery and it is accrued in the transaction database. In any event, the transaction 
database^will accrue all information associated with a particular routing code. 

With a realtime transaction, it is possible for a manufacturer to place an^ in 

1 0 a magazine or to place a product on a shelf at a particular time. The manufacturer 
can thereafter monitor the times when either the -ads are or the products are 
purchased. Of course, they must be scanned into a computer which will provide 
some delay. However, the manufacturer can gain a very current view of how a 
product is moving. For example, if a cola manufacturer were to provide a 

15 promotional advertisement on, for example, television, indicating that a new cola was 
going to be placed on the shelf and that the first 1000 purchasers, for example, 
scanning their code into the network would receive some benefit, such as a chance to 
win a trip to some famous resort in Florida or some other incentive, the manufacturer 
would have a very good idea as to how well the advertisement was received. Further, 

20 the advertiser would know where the receptive markets were. If this advertiser, for 
example, had placed the television advertisement in ten cities and received 
overwhelming response from one city, but very poor response from another city, he 
would then have some inclination to believe that eithei^one poor^esponse city was 
not a good market or that the advertising medium he had chosen was very poor. 

25 Since the advertiser can obtain a relatively instant response and also content with that 

response as to the demographics of the responder, very important information can be 
obtained in a relatively short time. 
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It should be noted that the disclosed embodiment is not limited to a single 
source PC 302, but may encompass a large number of source computers connected 
over a global communication network. Additionally, the embodiment is not limited 
5 to a single ARS 308 or a single advertiser server 3 1 2, but may include a plurality of 
ARS and advertiser systems, indicated by the addition of ARS 314 and advertiser 
server A 316, respectively. It should also be noted that this embodiment is not 
limited only to global communication networks, but also may be used with LAN, 
WAN, and peer-to-peer configurations. 

10 It should also be noted that the disclosed embodiment is not limited to a 

personal computer, but is also applicable to, for example, a Network Computer 
("NetPC"), a scaled-down version of the PC, or any system which accommodates 
user interaction and interfaces to information resources. 



15 One typical application of the above noted technique is for providing a 

triggering event during a program, such as a sport event. In a first example, this may 
be generated by an advertiser. One could imagine that, due to the cost of 
advertisements in a high profile sports program, there is a desire to utilize this time 
wiill^ If, for example, an advertiser contracted for 15 seconds worth of advertising 

20 time, they could insert within their program a tone containing the routing 

information. This routing information can then be output to the user's PC which will 
jot 

cause the user's PCJ^o, via the network, obtain information from a remote location 
typically controlled by the advertiser. This could be in the form of an advertisement 
of a length longer than that contracted for. Further, this could be an interactive type 
25 of advertisement. An important aspect to the type of interaction between the actual 
broadcast program with the embedded routing information and the manufacturer's 
site is the fact that there is pro vided 4frthe information as to the user's PC^and a 
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profile of the user themselves. Therefore, an advertiser can actually gain realtime 
information as to the number of individuals that are watching their particular 
advertisement and also information as to the background of those individuals, profile 
information, etc. This can be a very valuable asset to an advertiser. 

5 In another example, the producer of the program, whether it be an on-air 

program, a program embedded in a video tape, CD-ROM, DVD, or a cassette, can 
allow the user to automatically access additional information that is not displayed on 
the screen. For example, in a sporting event, various statistics can be provided to the 
user from a remote location, merely by the viewer watching the program. When 

10 these statistics are provided, the advertiser can be provided with profile information 
and background information regarding the user. This can be important when, for 
example, the user may record a sports program. If the manufacturer sees that this 
program routing code is being output from some device at a-kter time^than the actual 
broadcast itself, this allows the advertisers to actually see that their program is still 

15 being used and also what type of individual is using it. Alternatively, the broadcaster 
could determine the same and actually bill the advertiser an additional sum for a later 
broadcast. This is all due to the fact that the routing information automatically, 
through a PC and a network, will provide an indication to the advertiser i br other 
4ntermediar>r regarding the time at which the actual information was broadcast. 

20 The different type of medium that can be utilized with the above embodiment 

are such things as advertisements, which are discussed hereinabove, contests, games, 
news programs, education, coupon promotional programs, demonstration media 
(demos), photographs, all of which can be broadcast on a private site or a public site. 
This all will provide the ability to allow realtime interface with the network and the 

25 remote location for obtaining the routed information and also allow for realtime 
billing and accounting. 
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Referring now to FIGURE 16, there is illustrated a general block diagram of a 
disclosed embodiment. A bar code scanning wand 1600 is provided by a wand 
distributor to customers and is associated with that distributor via a wand ID stored 
therein. The wand 1600 is either sold or freely distributed to customers for use with 
5 their personal computing systems. Since more and more products are being sold 

using bar codes, it can be appreciated that a user having the wand 1600 can scan bar 
codes of a multitude of products in order to obtain more information. Information 
about these products can be made immediately available to the user from the 
manufacturer for presentation by the user's computer 302. Beyond simply displaying 

10 information about the product in which the user is interested, the wand distributor 
may include additional advertising information for display to the user such as 
information about other promotions or products provided or sold by the wand 
distributor. Similarly, advertisers may provide catalogs of advertisements or 
information in newspapers or periodicals where the user simply scans the bar code 

15 associated with the advertisement using the wand 1600 to obtain further information. 
There is provided a paper source 1602 having contained thereon an advertisement 
1604 and an associated bar code 1606. (Note that the disclosed concept is not limited 
to scanning of bar codes 1606 from paper sources 1602, but is also operable to scan a 
bar code 1606 on the product itself Also, the wand 1600 can be any type of device 

20 that will scan any type of image having information encoded therein.) Further 

description of applications and operation of the bar code scanning wand 1600 and the 
use of the bar code information is found in pending U.S. Patent Application, Serial 
No. 09/151,471 filed on September 1 1, 1998 and entitled "METHOD FOR 
INTERFACING SCANNED PRODUCT INFORMATION WITH A SOURCE FOR 

25 THE PRODUCT OVER A GLOBAL NETWORK," which application is 
incorporated by reference in its entirety herein. 
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After obtaining the wand 1600 from the wand distributor, the user connects 
the wand 1600 to their PC 302. During a scanning operation, wand 1600 reads bar 
code data 1606 and the wand ID into a "wedge" interface 1608 for conversion into 
keyboard data, which keyboard data is passed therefrom into the keyboard input port 
5 of PC 302. The importance of the wand ID will be discussed in more detail 
hereinbelow. 

The wedge interface 1608 is simply an interface box containing circuitry that 
accommodates inputs from both the scanning wand 1600 and a computer keyboard 

10 1610. This merely allows the information scanned by the wand 1600 to be input into 

the PC303 . In the disclosed embodiment, the wedge interface 1608 will convert any 
information. The data output from the wand 1600 is passed into the wedge interface 
1608 for conversion into keyboard data which is readily recognizable by the PC 302. 
Therefore, the wand 1600 is not required to be connected to a separate port on the PC 

15 302. This data is recognized as a sequence of keystrokes. However, the output of the 
wand 1600 can be input in any manner compatible with the PC 302. When not 
receiving scanner data, the wedge interface 1608 simply acts as a pass-through device 
for keyboard data from the keyboard 1610. In any case, the information is ultimately 
processed by a processor in the PC 302 and can be presented to the user on a display 

20 1612. The wedge interface's operable to provide a decoding fimction for the bar 

code,gnd conversion thereof to keystroke input data. 

In operation, the product code of a product is provided in the form of a bar 
code 1606. This bar code 1606 is the "link" to a product. The disclosed embodiment 
is operable to connect that product information contained in the bar code 1606 with a 
25 web page of the manufacturer of that product by utilizing the bar code 1606 as the 
product "identifier." The program operating on the PC 302 provides routing 
information to the ARS 308 after launching the browser on the PC 302 and 
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connecting to the ARS 308 over the GCN 306, which ARS 308 then performs the 
necessary steps to cause the browser to connect to the manufacturer web site, while 
also providing for an accounting step, as will be described in more detail 
hereinbelow. 

5 The bar code 1606 by itself is incompatible with any kind of network for the 

purposes of communication therewith. It is primarily provided for a retail-type 
setting. Therefore, the information contained in the bar code 1606, by itself, does not 
allow for anything other than identification of a product, assuming that one has a 
database 1614 containing information as to a correlation between the product and the 
10 barcode 1606. 

The wedge interface 1608 is operable to decode the bar code 1606 to extract 
the encoded information therein, and append to that decoded bar code informatior^^^ 
relating to an ID for the wand 1600. This information is then forwarded to the ARS|^ 
by the resident program in the PC 302. This is facilitated by intermediate routing 
£ 15 information stored in the program indicating to which node on the GCN 306 the 

scanned bar code information is to be sent, i.e., to the ARS 308. It is important to 
note that the information in the bar code 1606 must be converted from its optical 
image to numerical values which are then ultimately input to the keyboard input port 
of PC 302 and converted into data compatible with communication software residing 
20 on the PC 302 (in this case, HTML language for insertion into a browser program). 

When the scanned information is input to the PC 302, the resident program launches 
the browser program and then assembles a communication packet comprised of the 
URL of the ARS 308, the wand ID and the user ID. If another type of 
communications program were utilized, then it would have to be converted into 
25 language compatible with that program. Of course, a user could actually key in the 

information on the bar code 102 and then append the appropriate intermediate routing 
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information thereafter. As will be described hereinbelow, the intermediate routing 
information appended thereto is the URL of the ARS 308 disposed on the GCN 306. 

As part of the configuration for using the wand 1600, the PC 302 hosts wand 
software which is operable to interpret data transmitted from the wand 1600, and to 
create a message packet having the scanned product information and wand ID, 
routing information, and a user ID which identifies the user location of the wand 
1600. The wand software loads at boot-up of the PC 302 and runs in the background. 
In response to receiving a scanned bar code 1606, the wedge interface^utputs a 
keystroke code (e.g., ALT-FIO) to bring the wand program into the foreground for 
interaction by the operating system. The wand program then inserts the necessary 
information into the browser program. The message packet is then transmitted to 
interface 304 across the global communication network 306 to the ARS 308. The 
ARS 308 interrogates the message packet and performs a lookup function using the 
ARS database 310. If a match is found between particular parameters of the message 
packet, a return message packet is sent back to the PC 302 for processing. 

The wand program running on PC 302 fimctions to partition the browser 
window displayed to the user into several individual areas. This is for the purpose of 
preparing to present to the user selected information in each of the individual areas 
(also called "fi-aming"). The selected information comprises the product information 
20 which the user requested by scanning the bar code 1606 using the wand 1600, 

information about the wand distributor which establishes the identity of the company 
associated with that particular wand 1600, and at least one or more other fi-ames 
which may be advertisements related to other products that the wand distributor sells. 
Note that the advertisements displayed by the wand distributor may be related to the 
25 product of interest or totally unrelated. For example, if a user scans the bar code 
cu 1 606 of -a-^ompany A-sedtt;' the wand distributor may generate an advertisement of a 
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new soft drink being marketed by Company A, that it sells. On the other hand, the 
wand distributor may also structure the display of information to the user such that a 
user requesting product information of a Product X may get the requested 
information of Product X along with advertisements for a competing item Product Y. 
5 Essentially, the wand distributor is free to generate any advertisement to the user in 
response to the user requesting product information. 

The return message packet transmitted from the ARS 308 to the PC 302 is 
then transmitted back across the GCN 306 to the advertiser server 312. The 
advertiser server 312 restructures the message packet and appends the particular 
10 product information for transmission back to the PC 302. Upon receiving the 
particular advertiser information from advertiser server 312, the PC 302 then 
retransmits a message to the wand distributor site 1616 and E-commerce site 1618 to 
obtain the information that needs to be framed in the browser window displayed to 
the user. 

15 Therefore, the wand 1600 is associated with the wand distributor by way of a 

wand ID such that scanning a product bar code 1606 in order to obtain information 
about that particular product generates one or more responses from one or more 
remote sites disposed on the GCN 306. Stored in the wand 1600 is the wand ID 
which establishes its relationship to the wand distributor. Proprietary wand software 

20 running on the PC 302 operates to decode scanned bar code information and the 

wand ID received from the wand 1600 and wedge interface 1608, and also provides a 
unique user ID for establishing the location of the user of the wand 1600. The wand 
software also assembles message packets and works in conjunction with the bn-board 
communication software (e.g., a browser) to automatically route the message packets 

25 across the GCN 306 such that the one or more remote sites disposed on the GCN 306 
return information to be framed for presentation to the user. 
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Referring now to FIGURE 16a, there is illustrated an addition to the 
flowchart of FIGURE 14 for registering an input device, for one embodiment of the 
disclosure, with the ARS 308 in conjunction with a user ID. As described 
hereinabove, each user, when they generated their user profile when first contacting 
5 the ARS 308 to activate their software, defines a user ID for storage in their PC 

resident software. This user ID, as also described hereinabove, is utilized to identify 
the PC 302 to the ARS 308 whenever making a transaction. This is utilized for, 
among other things, updating profile information in the database 3 1 0. However, 
when an input device, such as the input device in the form of a wand 1600, is 

10 utilized, there are a number of ways to identify this wand 1600. One can be with the 
use of a unique wand ID associated with the wand 1600, as will be described 
hereinbelow. The other is to create a wand ID in the software program operating in 
the PC 302 running the PC resident background program as described hereinabove. 
In a situation where the ID is created in the program, reference is made to block 1410 

15 of FIGURE 14 and subsequent thereto. After the user has entered very specific 

information, jobs, history and demographics, etc., the system will then prompt the 
individual for information regarding the input device, as indicated by a function 
block 1630. This prompt will basically inquire as to whether the user has an input 
device for reading machine readable code or for sensing audible signals. It may 

20 desire to know whether the user has received an audible code from a broadcast 

system such as a TV, or the wand 1600 is being utilized to scan machine readable 
code in the form of a bar code. The program block will then flow to a fiinction block 
1632 wherein various input device types are presented to the user on their display 
returned over the network 306 firom the ARS 308, and then the user selects which 

25 type of input device is attached to their computer. For example, it might be a 

scanning wand, it might be an audio input device, or any other type of device that 
allows for input of information. For example, it is conceivable that the unique wand 
ID is that of some type of tool being utilized in conjunction with the program as an 
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input device. The unique want ID could even be the idea of a disk drive wherein the 
wand ID would be generalized as a tool ID. 

Once the type of input device is input, then the prompt will query what type 
of device is attached, such as the type of scanning wand 1600. The system will then 
5 ask for the distributor of the wand 1 600. Of course, as described hereinabove, the 

wand 1600 could have embedded therein a unique wand ID which would remove the 
need for inputting the distributor, as the ARS 308 will recognize this particular wand 
ID. However, in the situation wherein the wand ID is not disposed within the wand 
1600, then the user will have to view the wand or tool 1600 to determine the 

10 distributor thereof This is what input information would then be noted in the user 
profile in the ARS 308. This allows the ARS 308, at a later time, to match up the 
user ID, requiring no other user ID, with their user profile to determine what 
distributor distributed their wand 1600, such that information can be returned 
associated with that distributor, as will be described hereinbelow. Therefore, the 

15 combination of a user ID and a corresponding entry in the database of the ARS 308 

will constitute the wand ID or tool ID. 

Referring now to FIGURE 17, there is illustrated a conversion circuit of the 
wedge interface. A microcontroller 1 700 provides conversion of the data from the 
wand 1600 and controls interfacing of the keyboard 1610 and wand 1600 with the PC 

20 302. The microcontroller 1700 has contained therein a memory 1702 for storing a 
wand ID (or even a URL for some applications) or it can have external memory. 
There are provided a plurality of wand interfaces 1704 to the wand 1600, a plurality 
of PC interfaces 1706 to the PC 302, and plurality of keyboard interfaces 1708 to the 
keyboardj^:^. In general, the wand interfaces 1 704 comprise a serial data line, a 

25 ground line, and a power line. Similarly, the keyboard interfaces 1708 comprise a 
serial data line, a ground line, a clock line, and a power line. The PC 302 provides a 
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clock line, a power line, a serial data, and a ground line for input to the 
microcontroller 1700. The microcontroller 1700 is operable to receive signals from 
the keyboard 1610 and transfer the signals to the PC 302 as keyboard signals. 
Operation with the keyboard 1610 is essentially a "pass-through" procedure. Data 
5 output from the keyboard 1610 is already in keyboard format, and therefore requires 
no conversion by the wedge interface 1608. With respect to the wand 1600, the 
serial data is not compatible with a keyboard 1610 and, therefore, it must be 
converted into a keyboard format in order to allow input thereof to the keyboard 
input ofthe PC 302. 

The microcontroller 1700 performs the conversion function after decoding 
this bar code information, and conversion of this bar code information into an 
appropriate stream of data which is comprised of the bar code information and the 
appended wand ID (or even a URL in some applications). This appended wand ID 
(and/or URL) will be pre-stored in the memory 1702 and is programmable at the time 
of manufacture. It is noted that the memory 1702 is illustrated as being contained 
within the microcontroller 1 702 to provide a single chip solution. However, this 
could be external memory that is accessible by the microcontroller 1702. Therefore, 
the microcontroller 1700 provides an interface between the wand 1600 and the 
keyboard 1610 to the PC 302 which allows the wand 1600 to receive coded 
information and convert it to keyboard strokes or, alternatively, to merely pass- 
through the keystrokes from the keyboard 1610. Therefore, the user need not install 
any type of plug-in circuit board into the motherboard of the PC 302 in order to 
provide an interface to the wand 1600; rather, the user need only utilize the already 
available keyboard port in order to input the appropriate data into the system. 

25 In this particular disclosed embodiment, the microcontroller 1 700 comprises a 

PIC16C73 microcontroller by Microchip Technologies™, The PIC16C73 device is a 
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low cost CMOS 8-bit microcontroller with an integrated analog-to-digital converter. 
The PIC16C73 device, as illustrated in the disclosed embodiment, has 192 bytes of 
RAM and 4k x 4 of EPROM memory. The microcontroller 1700 can accommodate 
asynchronous or synchronous inputs from input devices connected to it. In this 
5 disclosed embodiment, communication to the keyboard 1610 is synchronous while it 

is asynchronous when communicating with wand 1600. 

It should be noted that, although in this particular embodiment bar code 
information of the bar code 1606 is input into the keyboard input port of the PC 302, 
disclosed methods may also be advantageously utilized with high speed port 
10 architectures such as Universal Serial Bus ("USB") and IEEE 1394. 

Bar codes are structured to be read in either direction. Timing considerations 
need to be addressed because of the variety of individuals scanning the bar code 
introduce a wide variety of scan rates. Bar codes use bars of varying widths. The 
presence of a black bar generates a positive pulse, and the absence of a black bar 

1 5 generates no pulse. Each character of a conventional bar code has associated 

therewith seven pulses or bars. Depending on the width of the bars, the time between 
pulses varies. In this disclosed embodiment, the interface circuitry 1608 performs a 
"running" calculation of the scan time based upon the rising edge of the pulses 
commencing with the leader or header information. The minimum and maximum 

20 scans times are calculated continuously in software with the interface 1608 during the 
scanning process to ensure a successful scan by the user. 



Referring now to FIGURE 18, there is illustrated a sample message packet 
transmitted from the user's PC 302 to the ARS^ The message packet 1800 comprises 
a number of bits of information includ^^g the bar code information 1802 obtained 
25 from the user scanning the bar code^with the wand 1600; the wand ID 1804 which is 
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embedded in a memory in the wand 1600 and identifies it with a particular wand 
distributor; and a user ID 1806 which is derived from the software running on the PC 
302 and which identifies uniquely with the user location. Note that the message 
packet includes other necessary information for the proper transmission for point to 
5 point. 

Referring now to FIGURE 19, there is illustrated a more detailed block 
diagram of the routing of the message packets in order to present the framed 
information to the user. As is mentioned hereinabove, when the user scans a bar 
code 1606 using the wand 1600, a wand program running on the user PC 302 is 

10 operable to interpret the information output by the wand 1600 and generate a 

message packet for transmission over the GCN 306. The wand program assembles 
the message packet such that it is directed to the ARS 308 disposed on the GCN 306. 
The message packet contains several pieces of information including the wand ID 
1804 which links it to the wand distributor, the user ID 1806 which identifies the 

15 particular user using the wand 1600, and bar code information^escribing a particular 
product of interest to the user. This message from the PC 302 is transmitted over a 
path 1900 to the ARS 308 where the ARS database 310 is accessed to cross reference 
the ID information,^na bar code information -te^ particular advertiser and wand 
distributor. The ARS 308 returns a message packet over a path 1902 to the user PC 

20 302 which contains routing information as to the location of various other sites 
disposed on the GCN 306, for example, the advertiser server 312 and wand 
distributor site 1616. 

It is noted that, when the wand (or tool) is utilized, the program at the PC may 
recognize this and merely input the user ID in the want (or tool) ID field. 
25 Altematively, the mere receipt of a user ID in association with product code 

information will trigger the ARS 308 to assume that the want 1600 was utilized. It is 
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only important that the use of the want (or tool) be recognized and that the user's PC 
be routed to a location on the network preassociated with that wand (or tool) 
distributor. Further, it is the routing of the user's PC to a predetermined location on 
the network based upon the use of a particular tool, a particular type of tool or a 
5 general class of tools that elicits the connection. For example, it would be that the 

network connection is made in response to the suer utilizing a barcode scanner. This 
would connect the user to a web site for a general barcode scanner tool. For a disk 
drive, the program would recognize that a disk drive had been installed (or merely 
used) and then route the user to the web site of the disk drive manufacturer, a 
10 competitor of such or even to some marketing firm that wants to contact individuals 
that use or initiate such a piece of equipment. 

It can be appreciated that other information can also be provided by the ARS 
308 which more closely targets the particular user of the wand 1600. For example, if 
it is known that a particular wand 1600 is sold in a certain geographic area, this 

15 information can be useful in targeting the particular user with certain advertising 

information relevant to that geographic area. In any case, the information returned 
from the ARS 308 over path 1902 provides enough information for the wand 
program running on the user PC 302 to identify a number of other sites disposed on 
the GCN 306. The user PC 302 then processes the return message packet and routes 

20 another message packet over a path 1904 to the advertiser server 312. The advertiser 
server 312 then returns product information of the particular product in which the 
user was interested back to the user PC 302 over a path 1906. Similarly, the user PC 
302 routes information (e.g., the URL of the wand distributor site and the user 
profile) to the wand distributor site 1616 over a path 1908 in order to obtain 

25 information back over a path 1910 for framing any banners which identify the wand 
distributor. Additionally, the user PC 302 forwards a message packet to the E- 
commerce site 1618 over a path 1912 in order to return information regarding any 
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particular advertisements the wand distributor wants to display to the user. The 
advertisements are returned to the PC 302 over a path 1914. 

Referring now to FIGURE 20, there is illustrated a block diagram of a 
browser window according to the disclosed embodiment. The browser window 2000 
5 is partitioned into a plurality of areas for framing specific information. A bar code 

area 2002 displays that product information in which the user was interested; a -wand- 
specifiG area 2004 displays information about the wand distributor; and an E- 
commerce area 2006 displays advertising information that the wand distributor 
selects for display according to this particular user and wand 1600. As mentioned 

10 hereinabove, a program operable to process scanned bar code information with the 

unique wand 1600 develops the browser window by partitioning it into specific areas 
for the framing of information. Therefore, information returned from the E- 
commerce site 1608 is passed through the GCN 306 to the particular E-commerce 
frame 2006. Similarly, information about the particular product of interest is 

15 returned from the advertiser site 312 across the GCN 306 to the particular bar code 
specific area 2002. Information placed in the wand specific area 2004 is information 
about the wand distributor which is retumed from the wand distributor site 1616 
across GCN 306. 

Referring now to FIGURE 21, there is illustrated a structure of information 
20 contained in the ARS database. The ARS database 310 contains a variety of 

information required to properly interrogate and assemble packets for obtaining 
information from the various sites disposed on the GCN 306. The ARS database 310 
has a database structure 2100 which contains addresses for the web sites containing 
the product information requested by the user when scanning the bar code 1606 with 
25 the wand 1600. Under a product heading 2102 are listed the particular bar codes and 
associated routing information for addressing the respective server location. For 
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example, the ARS server 308 may contain any number of advertisers having unique 
URL addresses associated therewith. Therefore, the bar code 1606 of a particular 
product is associated with a unique URL address which routes any request for 
information of that product to that particular advertiser's site. Also part of the ARS 
5 database structure 2000 is a heading of AwSi^nder which is the wand ID 1 804 and 

the distributor associated with that wand ID 1804. 

It can be appreciated that there may be a number of distributors using the 
disclosed architecture such that each distributor has an ID embedded in the wand 
which uniquely identifies that wand,^ith the particular distributor. Therefore, the 

10 unique wand ID 1804 needs to be listed with the respective distributors of that wand 
1600 in order to process the information that needs to be framed and displayed to that 
particular user. Another heading under the ARS database structure 2100 is a user 
heading 2106 which contains profile information associated with that particular user 
ID 1806. As mentioned hereinabove, the user ID 1806 is obtained via the wand 

15 software running on the PC 302 and upon installation or subsequent configuration 

may request that the user input certain profile information which may be used to 
target that particular user with products and services which identify with that user 
profile. The ARS database structure 2100 also contains an E-commerce heading 
2108 which contains information related to the bar code 1606 and an advertisement 

20 that may be triggered by the request for that information. For example, any bar code 
1606 associated with a paper sourcc4 606 ^can be associated with the specific 
information in the ARS database 310. A user wishing to obtain information about a 
specific soft drink may, in fact, trigger an advertising response of a competitor 
product. Similarly, the user interested in information about that particular soft drink 

25 may also trigger information which is relevant to that particular product or a product 

which may normally be served in conjunction with that soft drink. Furthermore, if 
the user profile indicates that this individual has significant interest in finance or 
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insurance, the request for information regarding this particular bar coded product 
may trigger advertisement from an E-commerce server 1618 related to information 
about finance and insurance. It should be noted that the information described as 
contained within the ARS database structure 2100 is not limited to what has been 
5 described, but may comprise any number of pieces of information used to present 
desired information to the computer display of the user. 

Referring now to FIGURE 22, there is illustrated a flowchart of the process of 
receiving information from the user's perspective, and according to the disclosed 
embodiment. The wand software running on the user's PC 302 runs in the 
background until activated by output from the wand 1600. Therefore, flow moves to 
a decision block 2200 where if a scanned input does not occur, flow moves out the 
"N" path and loops back to the input of decision block 2200. On the other hand, if 
scanned input information is received, flow moves out the "Y" path to a function 
block 2202 where the wand software assembles a message packet containing the bar 
code information, the wand ID 1804 and the ARS 308 URL address. Additionally, 
the browser is launched in which this information is placed for transmission to the 
ARS 308. Flow then moves to a function block 2204 where the browser is 
partitioned into any number of areas in which information is displayed when 
obtained from the wand distributor site 1616, the E-commerce site 1618, and the 
advertiser server 312. It should be known that although three frames are shown in 
the particular window 2000 of this embodiment, the number of frames displayed in 
the window 2000 is limited only by the available real estate of the window 2000 area 
itself 

After the wand software partitions the browser window into one or more 
25 frames in preparation of receipt of return information, flow moves to a decision block 

2206 where the computer waits for information to be returned from the various sites 
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disposed on the GCN 306. If information is not returned, flow moves out the "N" 
path and simply loops back to the input to continue monitoring for receipt of the 
information. If information has been received, flow moves out the "Y" path to a 
function block 2208 where routing information for each frame (or partitioned area of 
5 the window 2000) is inserted into one or more packets for transmission to the various 
sites. The various sites then return the requested information back to the PC 302, as 
indicated in function block 2210. Flow is then to a function block 2212 where the 
proprietary software working in conjunction with the hosted browser places the 
returned information into the respective frames of the window. The user, viewing the 
10 display at PC 302, then perceives a variety of information, one of which is the 
particular product information which he or she requested, in addition to wand 
distributor information, and possibly other advertisements based upon the user's 
profile. 

Referring now to FIGURE 23, there is illustrated a flowchart of the process 
15 according to the ARS. The ARS 308 is operable to decode and process^message^ 
received from the GCN 306. Therefore, flow is to a decision block 2300 where, if 
bar code information is not received, flow is out the "N" path with loop-back to its 
input. If bar code information has been received, flow is to a function block 2302 
where a matching process occurs to link the bar-coded product information to its 
20 respective manufacturer. The ARS database 310 also associates the URL address of 
the manufacturer's server. When a match is found, the ARS 308 begins to assemble 
a message packet of information for transmission back to the PC 302, as indicated in 
function block 2304. The message packet contains the product information and the 
URL address of the manufacturer's web site. Flow then moves to a decision block 
25 2306 where the wand ID 1804 is compared with the list of wand IDs issued by the 
particular wand distributor. If the wand ID 1 804 is validated, flow moves out the 
"Y" path to a function block 2308 where the message packet is appended with the 
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wand ID 1804 and distributor routing address. Flow then moves to a decision block 
2310 where the ARS 308 determines if any E-commerce information is to be 
associated with a particular wand ID 1804. If so, flow is out the "Y" path to a 
function block 2312 where the message packet is appended with the E-commerce 
5 routing string. The E-commerce routing string provides addressing for the E- 
commerce server 1618. Flow then moves to a function block 2314 where all 
message packets are returned back to the PC 302 for processing. 



Referring back to decision block 2306, if the wand ID 1804 is determined to 
be invalid, flow moves out the "N" path and jumps forward to the input of decision 

10 block 2314, since the lack of a wand ID 1804 interrupts the link to any advertising 
provided by the E-commerce server 1618. At this point, the only information 
provided is the link to the ^dvers e server 312 for return of product information. 
Referring now to decision block 2310, if no E-commerce information is available, 
flow moves out the "N" path and jumps forward to the input of function block 23 14 

15 where the message packet back to the PC 302 contains only the URL of the 

advertiser server 312, the bar code information, the distributor server 1616 address 
and wand ID 1804 information. 



Referring now to FIGURE 24, there is illustrated a flowchart of the process 
performed at the E-commerce site. The E-commerce server 1618 receives the 

20 message packet from the user PC 302, as indicated in function block 2400, and 

decodes the packet to perform a match with the bar coded information. Moving on to 
a decision block 2402, if the match is unsuccessful, flow is out the "N" path to a 
function block 2404 where the match is rejected. A message may be returned to 
indicate that a problem occurred and the user may need to re-scan the product bar 

25 code 1606. If a successful match occurs, flow moves out the "Y" path to a function 
block 2406 where the wand ID 1804 is matched with the bar code product 
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information. The bar coded information may be distributed to customers over a large 
geographic area. However, the wand 1606 may be coded for certain geographic 
areas. For example, a wand 1600 having an XXX ID may be restricted for sale in the 
Southwestem United States while a wand 1600 having a YYY ID may be sold only 
5 in the Northeast. In this way, geographic areas may be targeted with advertising 

more appealing to that particular area. Advertising returned to the user PC 302 may 
be focused further by obtaining a user profile when the software or wand 1600 are 
installed. In this way, advertising may be focused based upon the us er profile. 
Therefore, flow moves to a function block 2408 to lookup the E-commerce action 
10 based upon the wand ID 1804 and the bar code information. Flow moves to a 

function block 2410 to assemble all the information into a packet for return to the 
user PC 302. The product information and/or user profile information may be 
retumed. Flow is then to a function block 2412 where the message packet is 
transmitted. 

15 Referring now to FIGURE 25, there is illustrated a system for allowing an 

advertiser to offer a promotion over a broadcast system to a user utilizing the 
structure described hereinabove. From a general standpoint, this will allow the 
advertiser to provide over the broadcast channel, in the background, an audio or 
video indicia (or combination thereof) to a user which is sensed by the user PC 302 

20 and then the user PC 302 interconnected with a defined location on the networkjbr 
interfacing with the advertiser to actually promote some offer over the network 306 
utilizing the system described hereinabove. As described hereinabove, a broadcast 
signal is received by the receiver 110 which can be a television receiving a television 
broadcast, or even a radio. This will provide, in the case of the television, an audio 

25 and/or video output and, in the case of a radio, an audio output. This audio output is 
input to the user PC 302 by, for example, an audible connection via a speaker and 
microphone or by hard-wired connection. User PC 302 operates various programs 
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for sensing the audio system, as set forth in an operating program region 2502, and 
also as described hereinabove. This operating program region basically contains the 
operating programs that are running in the background or the foreground. In the 
present disclosure, a program will be running in the background or foreground to 
continually sense any audible signals that are received. In the event that a tone or 
specific signal is received that is recognized by the background operating program 
(or foreground operating program) as being associated with an advertisement, this x ^'u/<^b^ 
program will then cause the user PC 302 to interconnect with the-wA 306 through a 
web interface 2504, which is similar to the modem 114 described hereinabove with 
respect to FIGURE 1 . This allows a web interface 2504 to interface with the network 
306. In the present embodiment, the initial operation is performed by the operating 
program 2502 wherein a web browser is launched and the web browser utilized by 
the operating program to interface with locations on the network. However, it could 
be that the operating program in the background for sensing the audio and/or video 
signal does not require the web browser to interconnect with the network. It should 
be understood that this program could either interface directly with the network by 
directly interfacing with the TCP/IP gateway in the user PC 302, or utilize the web 
browser as the interface to the web 306. 

20 Initially, the web 306 is accessed such that information regarding the received 

tone, i.e., the decoded tone itself, is transmitted to the ARS 308. In this embodiment, 
the ARS 308 will have a promotional database 2506 associated therewith and a user 
profile database 2508. As described hereinabove, the user profile database 2508 is 
created when the user initially receives the particular operating program that allows 

25 sensing ofthe audio input and assessment access to the web 306. This will require 

the user to input a particular profile, which profile is then stored in the user profile 
database 2508 and a unique user ID associated with user PC 302 via the operating 
program for transmission at a later time to the ARS 308. When the ARS 308 
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receives this user ID, it can be compared with corresponding user IDs in the user 
profile database 2508 (of which there should only be one) and then extract the user's 
profile information. This basically allows user profile information to be stored 
without requiring it to be constantly re-transmitted from the user PC 302. However, 
5 it could be stored at the user PC 302. The promotional database 2506 contains 

information regarding the decoded information from the broadcast which was 
received by the user PC 302 and has associated therewith routing information. 
Therefore, for each encoded tone that is transmitted by the broadcaster, there will be 
an associated decoded word or value in the database 2506 with certain information 

10 associated therewith. A minimum requirement is that there be routing information to 

allow the user PC 302 interface to the network 306 to interconnect with a promotion 
offer location 2510. However, there could be other information that is transmitted. 
This information is then, as described hereinabove, relayed back to the user PC 302. 
This connection between the user PC 302 and the ARS 308 is represented by 

15 interconnection,^«ss 2512 in the network 306. 

After this information is returned to the user PC 302, the user PC 302 will 
utilize this routing information to interconnect the user PC with the promotion offer 
location 2510 to allow a bi-directional path, as represented by a path 2514 in the 

20 network 306. In addition to providing the routing information, the ARS 308 will also 

send back to the user PC 302 the user profile and any other information required by 
the promotion that would be stored in the promotional database 2506, and this will be 
assembled into a packet for transmission from the user PC 302 to the promotion offer 
location 2510 on the network 306. Note that the promotion offer location 2510 need 

25 not receive the code to understand what type of promotion was located. For example, 

it could be that the information returned to the user PC 302 for relay to the promotion 
offer location 2510 was a string of characters utilized by the browser consisting of 
domain name and subsequent instructions, which subsequent instructions would 
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indicate to the promotion offer location 2510 certain actions that needed to be taken 
through HTML instructions which are conventional. These, of course, are provided 
by the operator of the promotion offer location 2510 to the operator of the ARS 
location 308 for storage in the promotional database 2506. Thus, when the particular 
5 unique information is received from the user PC 302, which was forwarded thereto 
by the broadcaster, this information will be associated with any information that the 
operator of the promotion offer location offered, i.e., that the promoter wants to have 
associated therewith. This association, of course, is what the ARS 308 utilized to 
assemble a relay string, this being the URL of the promotion offer location 2510 and 
10 various other information associated therewith, such as particular HML codes for use 
by the promotion offerer. 

Referring now to FIGURE 26, there is illustrated a flowchart depicting the 
generation of the unique tone by the broadcaster. This is initiated at a block 2602 
and then proceeds to a block 2604 wherein a pre-announcement is sent of a 

1 5 promotion that is going to be offered by a promoter. The purpose of this is that the 
promoter would like to have as many individuals as possible join in the promotion. 
However, in order to recognize a tone or visual stimulus to a user, the user must have 
a PC running a particular proprietary software associated with the ARS 308 to 
provide the "listening" function. Therefore, this promotion can be provided to the 

20 user via the broadcast, either a short time before or even days before the actual 

promotion is offered. This is very similar to the situation wherein news programs 
advertise a newsworthy event and the reporting thereof on the "Eleven O'clock 
News," wherein the sum total of the advertisements for that news report far exceed 
the length of time of the actual news report, the pre-advertising luring viewers to the 

25 entire news report for the purpose of increasing viewership. Further, this allows the 
individual to, if they do not already possess the software, go to the web site for the 
ARS 308 or some other web site, and download the software. For example, the 
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advertisement would indicate that "for software to access this promotion, go to 
www.softwareprovider.com to download the required software." Alternatively, the 
announcement may just be a way to ensure people do not walk away from television 
during an advertisement interruption in a program. At a later time, an actual visual 
5 header is sent to the individual via the broadcast to indicate that the stimulus is about 
to be sent, as indicated in a fiinction block 2606. Typically, this will be some type of 
bouncing unique and recognizable "bug" that appears on one comer of the television 
set, which will be recognized by individuals as preceding a unique indicia of a 
network link. The program will then proceed to function block 2608 to send the 
10 unique tone or even a unique video signal in another embodiment, and into an End 
block 2610. 

Referring now to FIGURE 27, there is illustrated a flowchart depicting the 
operation at the promotion offer location 2510. The program is initiated at block 
2702 and proceeds to a decision block 2704 to determine if an Internet connection 

15 has been made to a new user requesting information. This, as described hereinabove, 
is facilitated by going to the ARS 308, requesting routing information and then using 
this routing information to make the connection. Also as described hereinabove, this 
is facilitated by sending a user ID and the encoded information from the received 
stimulus to the ARS 308. The program would continue in a loop until the connection 

20 is made, at which time it will proceed to a function block 2706 to receive the user 

profile and promotion header information which was provided by the ARS 308 in the 
form of a relay. The program then flows to a decision block 2708 to determine if the 
information has been received in a timely manner. There are certain situations 
wherein a promotion must be timely to obtain the full effect of a promotion. This 

25 could be thwarted in a situation wherein an individual would record the program with 
the advertisement sections and then use this to stimulate his computer. Further, this 
tone could be used to continually log on for a promotion to obtain more than "one 
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bite of the apple." Of course, in other situations, the promoter would welcome a 
request at any time and any number of requests from a single user. If it is not timely, 
the program will flow to a reject box 2710 and, if timely, the program will flow to 
function block 2712 to offer the promotion and then to an End block 2714. 

5 Referring now to FIGURE 28, there is illustrated a flowchart for the offer 

promotion operation at the location of the promoter, which initiated at a block 2802, 
then proceeds to function block 2804 wherein the user's profile is received and then 
to a multi-point decision block 2806 wherein the promotion is selected, or there 
could be a plurality of selections of different types of promotions offered by the same 

10 promoter. The type of promotion is determined by the header information forwarded 
to the promoter in conjunction with the information in the promotional database 
2506. One type of promotion could be a sweepstakes represented in block 2808, 
wherein all individuals are entered into some type of selection process offering a 
single large prize, this being solely for receiving the profile information stored in the 

15 user profile database 2508. Note that this is usually the main desire of a sweepstakes 
provider, other than to link it to its web page to try and solicit the purchase of 
magazines or other articles. By the means of a user profile in the user profile 
database 2508, this is an important step to bypass. Another promotion could be an 
electronic coupon, represented in a block 2810. These are referred to typically as 

20 ' ^couponB ,'^^ which would provide some type of coupon to an individual. Another 
type could be an interactive game, as represented by a block 2812, which allows the 
user to interface in an interactive manner with the promoter's web site. Another 
promotion is a sequencing-type promotion, indicated by a block 2814, wherein the 
individual is placed into a sequence and it^e place in the sequence that may produce 

25 the reward. 
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With respect to the sweepstakes, once the sweepstakes promotion is selected, 
the program proceeds from the function block 2808 to a function block 2816, 
wherein a customized reply or interface will be provided to the particular user based 
upon the profile information received. As such, a certain individual indicating a 
5 preference for books may be put into a sweepstakes associated with books and an 
individual indicating a strong preference for sports may be put into a sweepstakes 
associated with sports prizes. This provides possibly more incentive for an 
individual to spend time at a particular site. The program then flows to function 
block 2818 wherein the user is informed of the sweepstakes entry and how the user 
10 will be contacted in the future. The program then flows to an End block 2820. 

In the situation where the promotion is a coupon, the program will flow from 
block 2810 to a function block 2830 to generate a customized reply to the user based 
upon the user profile and the type of information to be presented to that particular 
user. It could be coupons for sporting events, associated with a strong sporting 

1 5 preference, or with literary events, associated with a strong literary preference. The 
program will then flow to function block 2832 wherein the user is informed of the 
coupon and how to exercise the coupon. This exercise may actually be a link to a 
book provider web site, wherein the user is actually provided a coupon on a web site. 
Further, the customized interface with the user could actually route that user, based 

20 upon preferences in the user profile, to a different web site to offer an electronic 

coupon. Once completed, the program flows to the End block 2820. Utilizing the 
interactive game, the program will flow from the function block 2812 to a function 
block 2834 wherein, again, the interface with the user is customized based upon 
preferences. A game of some type is initiated, as indicated by block 2836 and then 

25 the system interacts with the user, as indicated by function block 2838. The program, 
after completion of the interaction, will proceed to the End block 2820. 
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For the sequencing operation, this will first flow to a function block 2840 
from function block 2814 to customize the contest in accordance with the user's 
profile, as described hereinabove. The user is in place in a sequence, as indicated by 
function block 2842 and then a determination is made as to whether the user is a 
5 winner, as indicated by decision block 2844. If not, the program will go to function 
block 2846 to send a consolation prize, then to End block 2820. However, if the user 
is a winner, he will be informed by block 2848 and then proceed to function block 
2850 to send the prize, this being any number of incentives over the network, 
possibly in the form a credit or coupon, and then to the End block 2820. Although 
10 here are listed only four promotions, there can be any type of promotion that is 

offered in response to receiving the user profile and the actual connection with the 
user network via routing information proved by the ARS 308. 

Referring now to FIGURE 29, there is illustrated a flowchart depicting the 
operation of an advertiser sending a broadcast out over the web. The program is 

15 initiated at a block 2902 and then proceeds to a function block 2904, wherein a 
broadcast is generated. This broadcast typically is comprised of an advertising 
broadcast, which advertising broadcast is a portion of an overall broadcast or 
program. This broadcast is delivered at a predetermined time by a broadcasting 
station over some type of commercial or private broadcast network. During the 

20 broadcast, a tone is transmitted, as indicated by a function block 2906. This tone, as 
described hereinabove, is a unique tone which has digital information encoded 
therein. This tone with its digital information, as also described hereinabove, is 
received by the user's PC 302, decoded and the digital information extracted 
therefrom. It should be understood that a unique optical encoded area could be 

25 provided in place of the tone somewhere in the display area, with digital information 
embedded therein in the form of encoded information. This optical area can be read 
by the user PC 302 to extract the information therefrom. Further, any method for 
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delivering the encoded information to the user automatically is anticipated by this 
disclosure. 

After transmission of the tone, the program proceeds to a decision block 2908 
to wait for a response. If no response has been received, the program will flow along 
5 an "N" path to a timeout block 2910. This timeout function is to determine if the 

system is working. If the timeout has occurred, the program will default and, if not, 
it will loop back to the input of decision block 2908. When the response has been 
received, such as a user interconnecting with the network, the program will flow 
along a "Y" path to a function block 2912 to receive the information associated with 

10 the associated tone. It should be understood that a particular advertiser may receive 
multiple responses to multiple advertisements. Typically, this is set forth in the URL 
and the HTML code associated therewith. This code will typically route the user to a 
particular location on the advertiser's server. Once this information has been 
received, the program will flow to a function block 2914 wherein the user's profile 

15 will be received. As described hereinabove, this user's profile has been stored at the 

ARS 308 location, which is then relayed back to the user's PC 302 for assembly into 
a packet for transmission to the advertiser's location. The program will then flow to 
a function block 2916 to select standard information for a response, this being the 
basic starting point. The program will then flow to a function block 2918 to 

20 determine if this particular advertisement is to be customized for the user. In some 
situations, the response need only send the standard information. However, there are 
situations wherein the response needs to be customized for the user. It may be as 
simple as putting information in the header of the reply to the user such as "Hello 
John, here is the information you requested." It could also be much more complex in 

25 the form of the way in which the information is forwarded back to the user. It could 
be that the advertiser that returns information back to the user in response to their 
request would want to send certain other advertising information or links to the user. 
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If the user requested information regarding an alcohol commercial, there may be 
some link between alcohol consumers and outdoor sporting activities. A banner 
location (area in the display associated solely with advertisements) on the display 
sent back to the user may incorporate some advertising link with an outdoor sporting 
5 goods establishment. This advertiser could then get additional advertising revenue 
by providing this link to a user. Of course, this is based upon the user's profile 
indicating the user has a preference for sporting goods. If the user, alternatively, had 
a preference for traveling to Europe, a European travel site could be provided in this 
banner location. It is only important to note that the customization, if applicable, 

10 allows all information provided to be customized based upon the user's profile to 
more readily target a particular user's demographic information, desires and/or 
preferences. If not customized, the program flows along an "N" path to a fixnction 
block 2920 to send the standard information. If customized, the program would flow 
along a "Y" path to a function block 2922, wherein the response would be modified 

15 to send to the user in accordance with the preference of the profile. The program 

would then flow fi-om function blocks 2920 and 2922 to a fiinction block 2924. The 
program then flows to a decision block 2926 to determine if the connection has been 
completed, i.e., the user has logged off, and then to an End block 2928. 

With respect to the overall generating of the broadcast, the advertiser can 
20 utilize this broadcast generation to actually induce the individual to undertake some 
type of web-based initiative, or in general, access the network for the purpose of 
completing an e-commerce function or the such. This is done with a tone or, 
alternatively, a visual encoded logo. The consumer, when viewing a broadcast or 
listening to some type of radio program, would be subjected to a unique audio tone, 
25 having embedded therein digital information. This unique audio tone would be heard 
by the user and they would automatically look to their PC to determine what type of 
advertisement was present on their computer. If a visual encoded logo were utilized 
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it requires encoding the information in the logo or, ahematively, a visual unencoded 
logo may be utilized in connection with the audio encoded tone, which would cause 
the user to look to their computer. As an example, consider an advertiser that is 
advertising on a very expensive finals match in soccer or football. These costs can 
5 run up to many millions of dollars per minute. If an advertiser could utilize ten 

seconds, for example, to provide a very simple commercial with a tone embedded 
therein, this would automatically signal the user to turn their viewing attention to the 
computer and away fi-om the remaining advertisements. This is an inducement by a 
tone or a visual encoded logo. This assumes that the user has their PC on and has 
10 access to the Internet. Of course, conventional television sets having Internet based 
services are readily available. It is anticipated that virtually all broadcast viewing 
apparatus in the future will have web-based services, such that they will always be 
interconnectable to a network. 

15 Although the preferred embodiment has been described in detail, it should be 

understood that various changes, substitutions and alterations can be made therein 
without departing from the spirit and scope of the invention as defined by the 
appended claims. 
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